Line Card Port Protection Rate Limiter Circuitry 
Field of the invention 

[01] The invention relates to packet-switched communications, and in particular to 
line card input-port-based hardware-implemented link layer acceptance rate limiting 
5 control. 

Background of the invention 

[02] In the field of packet-switched communications, which includes, but is not 
limited to: X-25, Internet Protocol (IP), Frame Relay (FR), Asynchronous Transfer 
Mode (ATM), Synchronous Optical NETwork (SONET)/Synchronous Digital 

10 Hierarchy (SDH), etc. networking, it is important to limit the acceptance rate at which 
content is being accepted from a source, typically but not limited to a communications 
network node, to ensure: that the transport infrastructure of a communications network 
is not overburdened, that no single source makes excessive use of communications 
network resources to the detriment of other entities making use thereof, that Service 

15 Level Agreements (SLAs) are enforced, etc. 

[03] Packet-switched communications concern the conveyance of content segments 
encapsulated in Protocol Data Units (PDUs) between communications network nodes. 
Each PDU has an internal make-up, referred to as a "frame", which includes a start-of- 
frame marker, and a payload holding at least one content segment. PDU frame headers 
20 and trailers are populated with network addressing information, and (possibly) control 
information, to direct each PDU onto a corresponding transport path traversed in the 
communication network(s) between source and destination communications network 
nodes. 

[04] A novel approach has been undertaken in a related field concerning controlling 
25 the rate at which content is being conveyed in communications networks: 
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[05] A prior art Unites States Patent 5,313,454 entitled "Congestion Control for Cell 
Networks" which issued May 17 th , 1994, to Bustini et al., describes a feedback control 
mechanism for connection-session-based congestion prevention wherein network nodes 
traversed in a transport path of a corresponding virtual connection, report, using 
5 bandwidth reserved for the virtual connection, cell level system buffer occupancies to 
the destination network node associated with the virtual connection for interpretation, a 
feedback signal being sent, using bandwidth reserved for the virtual connection, to the 
source network node associated with the virtual connection which is expected to adjust 
the source network node transmission rate accordingly. Although inventive, the 

10 proposed solution is: limited to ATM content transport characterized by an end-to-end 
preprovisioned connection, the virtual connection incurs bandwidth overhead in 
conveying reports and feedback signals, involves virtual connection specific report 
tracking and interpretation at the destination network node, requires feedback signal 
interpretation at the source network node, and most importantly hinges on the 

15 cooperation of the source network node which in practice may not always be relied 
upon. An assessment regarding compliance with a customer SLA directly addresses 
issues related to a source network node's adherence to SLA agreed upon content 
transmission rates. 

[06] Other developments concentrate on output port rate limiting techniques to 
20 prevent output port buffers from overloading. These approaches to content conveyance 
rate control do not address input port congestion and therefore do not address limiting 
content acceptance rates in a communications network: 

[07] A prior art United States Patent No. 6,205,155 entitled "Apparatus and Method 
for Limiting Data Bursts in ATM Switch Utilizing Shared Bus" which issued on March 

25 20 th , 2001 to Parrella et al., describes an ATM cell-filtering approach to content 
conveyance rate control based on destination addresses to ensure that output port buffers 
do not overflow. While inventive in addressing output port congestion in ATM 
switches, no provisions are made for assessing adherence to SLAs in receiving content 
at a network node. Because the solution is destination address specific, it does not 

30 address denial of service attacks which flood traffic to multiple network addresses 
and/or setup a large numbers of virtual connections, both scenarios placing high 
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demands on the network node input port resources before the content is switched and 
output port queued. 

[08] Another prior art United States Patent No. 5,604,867 entitled "System for 
Transmitting Data between Bus and Network having Device Comprising First Counter 
5 for Providing Transmitting Rate and Second Counter for Limiting Frames Exceeding 
Rate" which issued February 1 8th, 2003 to Harwood, describes a system for limiting the 
number of multicast and broadcast frames generated by a network node from already 
accepted content to ensure that a shared bus and output port buffers are not overloaded. 
The two counter implementation also addresses issues related to content conveyance 
10 rate limiting while allowing some content bursting. Although inventive, the presented 
approach does not address issues concerning adherence to SLAs. Further SLAs concern 
all types of traffic generated by a source network node not just multicast and broadcast 
traffic. 

[09] Output port transmission rate limiting control as described in the above two prior 
15 art patents, would be beneficial in limiting content acceptance rates in communications 
networks, if such output port transmission rate limiting control was exercised at 
customer premise equipment. However, as customer premise equipment is not 
necessarily under the span of control of a service provider, managing an associated 
communications network, coupled with a disincentive for a customer to correctly and 
20 actively limit upstream output port rates, the presented solutions cannot be relied upon 
and are therefore insufficient. Therefore despite these prior advances, output port 
limiting employed on edge equipment aggregating upstream content traffic does not 
address issues related to input port contention for resources at edge network nodes. 

[10] Further, content generated by a source network node may be conveyed as 
25 connection specific traffic and connection less traffic. A lot of stack processing is 
involved in imposing conveyance rate limits at the connection level (typically supported 
by a higher layer content transport protocol) especially if the underlying content 
transport protocol employed is not a connection oriented content transport protocol. 

[11] FIG. 1 is exemplary of interconnected communications network equipment 
30 providing communications services to customers 100. Each customer 100, associated 
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with a customer network 101 and/or a customer node 102, is provided with access to 
communications services via a customer premise transceiver 104 and an access link 106. 
Each access link 106 is physically connected to a port 108 of a line card (interface card) 
1 10 of an access node 120 designated as an edge of a communications network 130. 

5 [12] In accordance with an exemplary approach, the content conveyed may be 
regarded by a particular network node receiving thereof for processing as a content 
stream (audio, video, ticker tape data, etc.), which is segmented into content segments, 
at least one content segment being conveyed packetized in payloads of individual PDUs 
conveyed. Content-stream-aware rate limiting control enforced at the particular 
10 network node (120): relates to a stream-aware content transport protocol such as, but 
not limited to: ATM; requires extensive tracking of the PDUs being conveyed in the 
context of each tracked content stream, thus employing large amounts of memory 
storage; and therefore is typically implemented at the network layer or above. 

[13] In accordance with another exemplary approach, conveyance rate limiting 

15 control enforced at a particular network node (120) may address the fact that a particular 
customer's source network node 102 makes excessive use of shared communications 
network resources to the detriment of other customers' 102 and 101/102. The content 
conveyed may be redirected around failure affected communications network 
infrastructure via redundant access links 1 06 as shown to be employed by the customer 

20 network 101. From the particular point of view of a network node 120 effecting rate 
limiting control, conveyed content originating from such a rogue source network node 
102, may be received at the network node 120 via multiple redundant interconnecting 
links 106. It is understood that if the rogue source network node 102 makes use of 
communications services via a customer's network 101, depending on the 

25 implementation of the customer's network 101, the entire customer network 101 may 
have to be labeled as a rogue customer network 101, if the particular rogue customer 
network node 102 cannot be identified distinctively (network addressing translation etc.) 
Source-network-node -based rate limiting control: requires extensive tracking of 
network node addressing and of PDUs received therefrom thus employing large 

30 amounts of memory storage; and therefore is typically implemented at the network layer 
or above. 
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[14] Network or higher layer implementations suffer from an intensive protocol stack 
processing necessary in inspecting each received PDU. Making reference to a typical 
prior art implementation shown in FIG. 2, in connection with both of the above 
presented exemplary approaches, central processing resources of the communications 
5 network node 120 including, but not limited to: system (typically, but not limited to, 
access node) central processor 122, bandwidth on the system data bus 124, central 
memory storage 126, etc are employed. Attempts at network and higher layer rate 
limiting control include software-based solutions which, although flexible and 
customizable, lack defined response time guarantees. The lack of defined response time 
10 guarantees leads to variable delays in processing received PDUs at communications 
network nodes 120 in the transport path, which leads to further overuse of processing 
resources including, but not limited to: memory storage overheads, processing 
bandwidth reductions, excessive content transport delays, excessively varying PDU 
inter-arrival time periods (jitter), etc. 

15 [15] With rate limiting control effected on received PDUs after the received PDUs 
have been stored in the central storage 126, a rogue source network node 102 may create 
contention for bandwidth on the system data bus 124 by sending a large number of 
PDUs at high rates, the contention unfairly drowning out content traffic received via 
other physical ports 108 associated with well behaving network nodes 102, before the 

20 system processor 1 22 has a chance to assess the degree to which the latter are affected. 

[16] There therefore is a need to solve the above mentioned issues in effecting 
content traffic control. 

Summary of the invention 

[17] In accordance with an aspect of the invention, a physical port controller is 
25 provided. A single up-down counter associated with the physical port controller is 
incremented as content is received via a corresponding input port, and decremented at a 
rate at which the input port is serviced. A maximum burst size register holds a value 
corresponding to a maximum amount of content the input port is permitted to receive as 
content is being received by the input port at a rate above the input port service rate. A 
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(first) comparator providing, in real time, an acceptance rate limiting control signal in 
comparing the value of the up-down counter to the value of the maximum burst size 
register. The acceptance rate limiting control signal provides a link-layer input port- 
based hardware implemented acceptance rate limiting control. 

5 [18] In accordance with another aspect of the invention, the physical port controller 
includes a committed rate register holding a value representative of a port service rate. 
With the service rate corresponding to a Service Level Agreement committed rate, the 
input port-based hardware implemented acceptance rate limiting control enforces a 
corresponding SLA agreement. 

10 [19] In accordance with a further aspect of the invention, the physical port controller 
includes means for introducing hysteresis in effecting acceptance rate limiting control as 
the value of the up-down counter transitions between a maximum burst size value held 
in a maximum burst size register and a low watermark value held in a low watermark 
register. 

15 [20] In accordance with a further aspect of the invention, the physical port controller 
includes means for providing an assessment of a degree of non-compliance to a 
corresponding SLA. 

[21] In accordance with a further aspect of the invention, a line card having a 
physical port controller enforcing a corresponding SLA is provided. 

20 [22] In accordance with a further aspect of the invention, a multi-ported line card 
having a plurality of physical port controllers is provided. The combined operation of 
the plurality of physical port controllers enforcing acceptance rate limiting control, 
enforces bandwidth reservations for each corresponding input port on a data bus to 
which the multi-ported line card is connectable to. 

25 [23] In accordance with a further aspect of the invention, a multi-ported network 
node having a plurality of physical port controllers is provided. The combined 
operation of the plurality of physical port controllers enforcing acceptance rate limiting 
control, enforces bandwidth reservations for each corresponding input port on a data bus 
servicing the corresponding plurality of physical ports. 
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[24] In accordance with yet another aspect of the invention, a method of enforcing 
acceptance rate limiting control for an input port is provided. Method steps include 
incrementing a single up-down counter associated with the input port as content is 
received and decrementing the single up-down counter at an input port service rate. An 
5 acceptance rate limiting control signal is activated upon determining that the value of 
the single up-down counter is greater than a maximum burst size value, and deactivating 
the acceptance rate limiting control signal upon determining that the value of the up- 
down counter is lower than a low watermark value. The activation and the deactivation 
of the acceptance rate limiting control signal with the service rate set at an agreed upon 
10 SLA committed rate enforcing the SLA at the input port. 

[25] The advantages of the port-based hardware content acceptance control achieved 
are derived from a deterministic response enforced at line rate as content is being 
received employing a small number of logic gates. 

Brief description of the drawings 

15 [26] The features and advantages of the invention will become more apparent from 
the following detailed description of the exemplary embodiment(s) with reference to the 
attached diagrams wherein: 

FIG. 1 is a schematic diagram showing typical interconnected communications 
equipment providing content transport in support of communications services; 

20 FIG. 2 is a schematic diagram showing typical elements of prior art software- 

based and/or system-processor-aided content conveyance rate control; 

FIG. 3 is a schematic diagram showing, in accordance with an exemplary 
embodiment of the invention, an exemplary physical-port-based hardware content 
acceptance rate control implementation; 

25 FIG. 4 is another schematic diagram showing, in accordance with the exemplary 

embodiment of the invention, another exemplary physical-port-based hardware content 
acceptance rate control implementation; 
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FIG. 5 is a further schematic diagram showing, in accordance with the 
exemplary embodiment of the invention, a further exemplary physical-port-based 
hardware content acceptance rate control implementation; 

FIG. 6 is a further schematic diagram showing, in accordance with the 
5 exemplary embodiment of the invention, a further exemplary physical-port-based 
hardware content acceptance rate control implementation; 

FIG. 7 is yet another schematic diagram showing, in accordance with the 
exemplary embodiment of the invention, yet another exemplary physical-port-based 
hardware content acceptance rate control implementation; 

10 FIG. 8 is a graphical representation of an exemplary content acceptance rate 

controlled traffic pattern at an exemplary physical port, in accordance with the 
exemplary embodiment of the invention; and 

FIG. 9 is a schematic diagram showing, in accordance with the exemplary 
embodiment of the invention, an exemplary implementation of a tracking mechanism 
15 employed in providing an assessment of a degree to which an content was discarded in 
enforcing acceptance rate limiting control for a port. 

[27] It will be noted that in the attached diagrams like features bear similar labels. 
Detailed description of the embodiments 

[28] Acceptance rate control solutions may depend, but not exclusively, on: the 
20 ultimate type of control desired, the available computing power to effect acceptance rate 
limiting control, the desired granularity of the conveyance rate limiting control, the 
communications equipment on which conveyance rate limiting control is to be 
implemented, etc. 

[29] In accordance with the exemplary embodiment of the invention, in order to: 
25 protect a communications network from abuse, ensure fairness, and provide flexibility 
in the utilization of communication network resources, while enforcing adherence to 
SLA agreements; an input-port-based hardware-implemented link layer acceptance rate 
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limiting control is provided, operating irrespective of whether the traffic is connection- 
oriented or connectionless, and irrespective of destination thereof: 

[30] Of particular relevance are input-port-based hardware content acceptance rate 
control implementations for multi-ported line cards 210, examples of which are shown 
5 in FIG. 3, FIG. 4, FIG. 5, FIG. 6, and FIG. 7. As is typical of current hardware line card 
design, in view of market drivers such as, but not limited to: miniaturization, box 
consolidation, low cost, increased port density, increased transport bandwidth, etc.; for 
line cards 210 to run close to maximum data bus (224) throughput, frame and content 
processing bandwidth is oversold - the aggregate physical bandwidth of all ports 208 of 
10 each line card 210 being larger than the bandwidth of the network node system data bus 
224. 

[31] In accordance with an n-port Ethernet line card 210, but not limited thereto, a 
fraction of the bandwidth available at one corresponding port 208 of the n ports 208, 
each operating at corresponding physical rates, is committed, via a customer SLA, for 
15 content transport in the up-link direction. If the customer transmits content at a rate 
above the SLA specified committed rate, by more than an allowed maximum burst size, 
then some of the transmitted content is to be dropped until the maximum (average) 
transmit rate drops to or below the SLA specified committed rate. 

[32] The shared resources of the n-port Ethernet card 210 must be allocated such that 
20 the total bandwidth committed to all the ports 208, and by extension to all 
corresponding customers 100, will not exceed the processing bandwidth of the shared 
resources on the line card 210, between which the bandwidth of the data bus 224. If one 
of the customers exceeds the bandwidth committed thereto and therefore if the 
corresponding port 208 on the line card 210 receives content at a rate above the SLA 
25 agreed upon committed rate, then at least some of the other customers 100 associated 
with the other n-1 ports 210 on the line card 210 may not be serviced in accordance with 
their SLAs. Therefore in enforcing acceptance rate limiting control, it must be ensured 
that configuring ports 208 in accordance with customer SLAs, the aggregate of all 
committed rates guaranteed for all serviced customers serviced via the line card 210 is 
30 less or equals to the bandwidth of the system data bus 224 to prevent frame drops. 
Typically customers 100 are assigned corresponding SLA committed rates at or below 
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the physical rate the corresponding physical port 208 can operate at, and at or below the 
physical rate of the data bus 224 can operate at. 

[33] Multiported line cards 210 are employed in communications network node 
systems 1 20 - the solutions presented herein may also be employed in any multiported 
5 network node equipment in which multiple ports contend for limited resources, such as 
but not limited to, bandwidth on a data bus. The description of the provided solution 
will be presented with respect to a generic multiported line card in order to detach the 
solution to the above presented problem from other content processing tasks typically 
performed by a communications network node including but not limited to: queuing 
10 disciplines, queue service disciplines, buffer congestion, switching, transport protocol 
dependent issues, etc. The particulars of exemplary embodiment of the invention 
presented herein with respect to a line card can equally be applied to multiported 
network equipment. 

[34] A degree of flexibility is sought as content traffic conveyance patterns are 
15 inherently bursty over various time scales which is representative of a typical on- 
demand utilization of communications services. It is desirable that acceptance rate 
limiting control not be too strict as the need for content transport is typically sporadic 
yet intense (bursty) to provide a snappy response (perceived as a momentarily fast 
access although unsustainable in accordance with SLA agreements). It is desirable 
20 therefore that for short periods of time, as other ports 208 do not convey content 
momentarily, that a momentarily active port 208 receive more than its SLA agreed upon 
fair share of bandwidth, of course long term SLA agreed upon rates being observed. 
For this reason interrupt (274) and/or polling techniques are typically used, between the 
ports 208 and a traffic management function 222 of the network node, to inform the 
25 traffic management function 222 that content is available in a corresponding port 
receive buffer 212. However, should other ports 208 also be active, content conveyed 
via the other ports 208 should not be unduly suppressed because the highly active port 
208, perhaps corresponding to a rogue customer network node 102, uses more network 
node resources more often. 

30 [35] In accordance with an exemplary embodiment of the invention, making 
particular reference to FIG. 3, FIG. 4, FIG. 5, FIG. 6, and FIG. 7, a leaky-bucket-type 
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physical-port-based acceptance rate limiting hardware-implemented controller 209 is 
employed for each port 208 on an exemplary line card 210 as shown. A single up-down 
counter 250 is provided per port 208 to implement rate limiting control by tracking port 
receive buffer (212) occupancies, at reduced implementation costs. Also provided per 
5 port 208 is a first register settable to, and holding, a threshold value corresponding to a 
maximum amount of content the receive port buffer 212 is allowed to store, on a limited 
time basis, as content is being received temporarily faster than the SLA agreed upon 
committed rate. The first register will be referred to herein as the maximum burst size 
register 254. It is intended, as will be described herein below, that rate limiting control 
10 be exercised should the receive port buffer occupancy exceed the value held in the 
maximum burst size register 254. 

[36] In accordance with the exemplary embodiment of the invention, the acceptance 
rate limiting control, being actively exercised, is intended to continue (hysteresis) until 
the receive port buffer occupancy level subsides substantially. Further provided per port 
15 208 is a second register settable to, and holding, a low watermark value corresponding 
to a number of bytes the receive port buffer 2 1 2 is allowed to store, expecting that the 
receive port buffer occupancy level will continue to subside as frames received via the 
corresponding physical port 208, begin to be accepted again. The second register will 
be referred to herein as the low watermark register 252. 

20 [37] The line card 210 implementation include, but is not limited to, Ethernet line 
card 210 implementations. Such link-layer hardware-implemented acceptance rate 
limiting control on an Ethernet line card 210 enforces an SLA agreed upon committed 
rate treating equally all types of content traffic conveyed including: connection-oriented 
traffic, connectionless traffic, prioritized traffic, differentiated traffic, Virtual Local Area 

25 Network (VLAN) traffic, etc. irrespective of the source and/or destination network 
nodes associated therewith. 

[38] In accordance with an exemplary implementation of the exemplary embodiment 
of the invention, presented in FIG. 3, FIG. 4, and FIG. 5, customer 100, and therefore 
corresponding port 208, -specific SLA agreed upon committed rate information is 
30 provided to the traffic management module 222 associated with the network node 
system 120 and particularly stored in a committed rate register 253. The traffic 
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management module 222, operating in accordance with port service disciplines 
described elsewhere, services, at least on average, each physical port 208 at the 
committed rate corresponding thereto. More details are presented herein below with 
reference to a port select signal 282. 

5 [39] Accordingly, assuming that the traffic management module 222 causes the 
receive port buffer 212 to be emptied, on average, at the committed rate, comparators 
256 and 258 respectively determine whether the content reception rate conforms to the 
SLA agreed upon committed rate by monitoring the port's receive buffer occupancy 
levels. 

[40] Assuming that the system services the receive port buffer 212 at the committed 
rate, content accumulates in the receive port buffer 212 only when content js being 
received at a rate higher than the committed rate; the receive port buffer occupancy 
level remaining zero if content is being received at a rate lower than the committed rate. 
A first comparator 258 determines when the port's receive buffer occupancy level is 
above the maximum burst size threshold specified via the maximum burst size register 
254. The output of the first comparator 258 is provided to the "J" input of a "J-K" flip- 
flop 260. It will be understood that the J-K flip-flop is representative of a larger class of 
electronic components known as master-slave flip-flops, the description of the operation 
of the hardware port-based rate limiting controller 209 presented herein being intended 
only to make exemplary reference to, and use of, J-K flip-flops. 

[41] A receive block 264 detects and extracts valid receive frame markers and valid 
received frame bits from a signal received over a physical (access) link (106) connected 
thereto. More information regarding "valid" frames and "valid" bits will be provided 
below with reference to setting the low watermark level to zero. The extracted valid 
25 frame markers are used to derive a "receiving frame" signal 266 which is kept logically 
active while a valid frame is actively being received. The J-K flip-flop 260 is clocked 
on the raising edge of the receiving frame signal 266 provided thereto. On receiving the 
next frame, the J-K flip-flop 260 provides an acceptance rate limiting control signal Q- 
bar which is used, as will be described below, in suppressing (acceptance) storage of 
30 subsequently received frames in the port's receive buffer 2 1 2. 
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[42] As the occupancy level of the receive port buffer 212 subsides, the second 
comparator 256 determines whether the occupancy level of the port's receive buffer 212 
is below the low watermark value held in the low watermark register 252. The output of 
the second comparator 256 is provided to the "K" input of the J-K flip-flop 260. With 
5 the J-K flip-flop 260 being clocked (266) as frames are being received, the acceptance 
rate limiting control signal from the output Q-bar of the J-K flip-flop 260 exhibits the 
desired hysteresis characteristics sought as described above. 

[43] It is understood that using an J-K flip-flop 260, hysteresis is achieved via a 
hardware implementation employing a small number of logic gates/electronic 
10 components at minimal implementation costs ensuring: implementation stability, a 
clean start up, and support for testing. Other master-slave flip-flops may be employed 
instead providing a variety of further features and further optimizations. 

[44] The rest of the implementation details will be described briefly to present further 
operations and features of the link layer input-port-based hardware-implemented 
1 5 acceptance rate limiting control provided. 

[45] In accordance with the exemplary implementation of the exemplary embodiment 
presented in FIG. 3, content is being exemplary conveyed at a lOMb/s nominal line rate 
over a corresponding link 106. A 10MHz receive clock 262 is provided to the port 208 
to aid the receive block 264 in extracting valid bits from the received signal. 

20 [46] The raising edge of the receiving frame signal 266 is further employed to reset 
an accumulation register 268, after which the accumulation register 268 gathers a valid 
sequence of frame bits extracted by the receive block 264. The accumulation register 
268 has a selected accumulation width which relates to the content acceptance control 
granularity. In accordance with the exemplary implementation presented in FIG. 3, the 

25 accumulation width is 8 bits and therefore a byte level granularity conformance with the 
SLA being detected, the content acceptance rate limiting control is being applied to 
received frames. 

[47] A line clock signal (262) and the receiving frame signal 266 are provided to a 
multi-input AND gate 270 which produces a signal train repeating at the line rate 
30 throughout the duration of each valid and allowed frame, in real time, as the frame is 
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actively received. The determination as to whether a particular frame being received is 
allowed, is provided by the acceptance rate limiting control signal from the Q-bar output 
of the J-K flip-flop 260. 

[48] As the frame bits are being accumulated in the accumulation register 268, a 
5 corresponding bit counter 272, having a counting width corresponding to the 
accumulation width of the accumulation register 268, counts valid accepted frame bits 
being received in accordance with the signal train output by the AND gate 270, and rolls 
over as the accumulation register 268 fills up. The rollover event of the bit counter 272 
is employed to load, in accordance with the exemplary implementation presented in 

10 FIG. 3, frame bytes stored in the accumulation register 268 into the receive port buffer 
212. The rollover event of the bit counter register 272 is further employed by the up- 
down counter 250 to increment the number of bytes added to the receive port buffer 
212. Auxiliary receive port buffer circuitry (not shown) generates the content ready 
signal 274 derived from the falling edge of the receiving frame signal 266 to signal 

15 content availability in the receive port buffer 212 to the traffic management function 
222. 

[49] The receive port buffer 212 is emptied via the data bus 224. Transactions on the 
data bus 224 typically run at a different clock frequency provided by a data bus strobe 
280. 

20 [50] In accordance with the exemplary implementation depicted in FIG. 3, FIG. 4, 
and FIG. 5, actual content extraction from the receive port buffer 212 may be tracked by 
counting bus transaction reading content from the receive port buffer 212. A particular 
port 208 is selected to be serviced by the traffic management module 222 to extract 
frames from the corresponding receive port buffer 212 by employing a port select signal 

25 282. Bus transaction instances reading content from the receive port buffer 212 of a 
particular port 208 are identified from a logical combination of the bus clock signal 
(280), the corresponding port select signal 282, and a bus ready signal 284, etc. typically 
implemented via a multi-input AND gate 286. 

[51] The amount of content extracted from the port receive buffer 212 in each data 
30 bus transaction is dependent on the (data) width of the data bus 224. In accordance with 
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the exemplary implementation of the exemplary embodiment of the invention, shown in 
FIG. 3, the data bus strobe 280 runs at 25MHz and the data bus 224 is 4 bits wide - a 
nibble being transacted over the data bus 224 during each bus clock cycle (280). 

[52] In accordance with the exemplary implementation of the exemplary embodiment 
of the invention presented in FIG. 3, a 1-bit counter 288 (or a D flip-flop) is employed 
to convert the number of nibbles extracted from the receive port buffer 212 into a 
number of extracted bytes. The rollover event of the 1-bit counter 288 (or the output of 
the D flip-flop), marking extracted byte boundaries, is provided to the up-down counter 
250 to decrement the value thereof in tracking the occupancy of the receive port buffer 
212. 

[53] FIG. 4 and FIG. 5 depict further exemplary implementations of the exemplary 
embodiment of the invention, for lOOMb/s and 1Gb ports 208 which employ: a 100MHz 
and a 1GHz receive clock respectively; a 16bit and a 32bit accumulation register 268 
respectively; a 4-bit and a 5-bit accumulation counter 272 respectively; the single up- 
15 down counter 250 tracking receive port buffer occupancy in words and double words 
respectively; and an 16-bit and a 32-bit data bus 244 respectively running at lOOHMz 
and 333MHz (280) respectively. 

[54] As the traffic management module 222 services the receive port buffer 2 1 2 at the 
SLA agreed upon committed rate specified in the committed rate register 253, the 
20 desired link layer hardware implemented input-port-based acceptance rate limiting 
control is achieved in a steady state operation of exemplary implementation of the 
exemplary embodiment of the invention: 

[55] The low watermark threshold value of the low watermark register 252 may 
theoretically be set to zero, however in practice a zero low watermark threshold value 
would require an intensive utilization of a lot of resources at the network node 120. For 
certainty, content is being received at line rate as described above respecting the 
operation of bit counter 272. As the line rate is typically greater than the committed 
rate, the corresponding transceiver 104 transmits content bearing frames and empty 
frames. Typically empty frames are marked as such, the valid frames mentioned herein 
correspond to content bearing frames. The selection of values for the maximum burst 
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size register 254 and the low watermark register 252 not only have to take into account 
the SLA agreement but also the physical content reception characteristics of the 
corresponding physical port. 

[56] Desired network node system (120) operation may benefit from a number frames 
5 being accumulated in the port receive buffer 212 before being extracted therefrom to 
optimize other aspects (274) related to the operation of the network node system 212 
and described elsewhere. For greater certainty, although the description of the presented 
solution relates to a receive port buffer 212, the maximum burst size threshold value 
held by the maximum burst size register 254, and the low watermark value held by the 
10 low watermark register 252 may be employed separately from circuitry employed in 
tracking, identifying, and mitigating input port congestion. The exemplary 
implementations of the exemplary embodiment of the invention described herein 
following employ methods which further distance acceptance rate limiting control from 
input port congestion mitigation. 

15 [57] In accordance with the exemplary embodiment of the invention, link layer 
hardware implemented acceptance rate limiting control may be exercised based on a 
"pseudo" receive port buffer occupancy level and a "pseudo" receive port buffer service 
rate without tracking actual data bus 224 transactions corresponding to content 
extraction from the port receive buffer 212. 

20 [58] FIG. 6 depicts an exemplary implementation of the exemplary embodiment of 
the invention, for a lOOMb/s port 208 which employs: a 100MHz receive clock; an 8bit 
accumulation register 268; a 3-bit accumulation counter 272; the single up-down 
counter 250 tracking receive port buffer pseudo occupancy in bytes; and a 32-bit data 
bus 244 running at 333MHz. The (pseudo) receive port buffer occupancy is increased, 

25 as described above, based on actual content reception and acceptance, and decreased at a 
constant rate corresponding to the SLA agreed upon committed rate. 

[59] A committed rate register 253, associated with the port's acceptance rate limiting 
controller 209, stores a numeric value used to program an adjustable clock 257 to create 
a signal train at a frequency corresponding to the SLA committed rate and therefore 
30 represents an intended pseudo receive port buffer service rate. The signal train is 
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employed by the single up-down counter 250 to decrease the value thereof at the SLA 
agreed upon committed rate which on average is expected to be the rate at which the 
port receive buffer 212 is being serviced by the traffic management function 222. 

[60] In accordance with another implementation of the exemplary embodiment of the 
5 invention shown in FIG. 7, the committed rate register 253 holds a value used obtain 
signal trains from the receive clock 262 having fractional rates thereof, the value of the 
committed rate register 253 being used to program a frequency divider 259. 

[61] Whether the signal train employed in decrementing the single up-down counter 
250 is synchronized to the port receive clock 262 as shown in FIG. 7 or not relates to 
10 whether a synchronous up-down counter 250 is employed and left to design choice. 

[62] With the single up-down counter 250 tracking pseudo receive port buffer 
occupancy, the low watermark threshold value of the low watermark register 252 may 
be set to zero. 

[63] With the adjustable clock 257, or the frequency divider 259, causing the up- 
15 down counter 258 to decrement at a constant rate regardless of the occupancy level of 
the receive port buffer 212, it is possible for the single up-down counter 250 to take on 
negative values (if unchecked) during long periods during which the port 208 does not 
receive content. To alleviate this condition, a saturating counter may be employed 
which would not decrement the value of the single up-down counter 250 below zero by 
20 design. To reduce costs however, a signal derived from the negative bit of the counter 
value may be used to reset the up-down counter 250 to zero. 

[64] FIG. 8 depicts a traffic pattern resulting from the exemplary acceptance rate 
limiting control presented being enforced at a port 208 receiving a large content burst. 
Frames are being dropped in accordance with an acceptance rate limiting control signal 
25 Q-bar only as the (pseudo) port receive buffer occupancy level of the port 208 exceeds 
the maximum burst size, the acceptance rate limiting control signal being reset as the 
receive port buffer 212 is emptied after the receive rate falls below the low watermark 
threshold value. 
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[65] Alternatively the fact that the value of the single up-down counter 250 may be 
allowed to take on negative value during time periods during which the port 208 does 
not transmit in support of credit-based arbitration, to give the port 208 credit for not 
having required servicing for a while to the benefit of other ports on the line card 210. 
5 Such low level control (LLCTRL) is shown at 290. 

[66] The port-based hardware acceptance rate limiting control presented herein is 
achieved with a deterministic response enforced in real time, at line rate, as content is 
being received employing a small number of logic gates. 

[67] By extension, it is understood that the solution presented herein above may be 
10 employed in connecting service provider networks via access links to Wide Area 
Networks (WAN) with due change of particulars. 

[68] Besides the benefits of an Ethernet specific implementation mentioned herein 
above, the generically described link layer port-based hardware implemented acceptance 
rate limiting control may be implemented on multi-ported line cards 208 supporting 
15 other content transport protocols including but not limited to: X-25, IP, FR, ATM, 
SONET/SDH, etc. A frame level acceptance rate limiting control may be employed in 
respect of frames conveyed in accordance with a content transport protocol employing 
fixed sized frames such as, but not limited to, ATM cell transport. 

[69] A degree of (non-)adherence to a corresponding the committed rate, agreed upon 
20 and specified in a corresponding SLA, may be provided to a customer 100(/101) in 
terms of the number of frame drops and/or discarded content, as shown in FIG. 9, by 
counting valid frame markers and/or valid frame bits received while the frame 
acceptance is actively suppressed. A Q signal output by the exemplary J-K flip-flop 260 
is logically ANDed 292 with the receiving frame signal 266, the resulting signal being 
25 provided to a dropped frame counter 294. The Q signal output by the exemplary J-K 
flip-flop 260 is further logically ANDed 296 with the receiving frame signal 266, and 
the receive clock signal (262), the resulting signal being provided to a dropped content 
counter 298. 

[70] The embodiments presented are exemplary only and persons skilled in the art 
30 would appreciate that variations to the above described embodiments may be made 
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without departing from the spirit of the invention. The scope of the invention is solely 
defined by the appended claims. 
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